AD-A115  35<*  STANFORO  UNIV  CA  F/6  12/1 

CONSTRUCTING  A  MINIMAL  COST  SPANNING  TREE  SUBJECT  TO  RESOURCE  C~ ETCtU) 
NOV  81  AW  SHOGAN  N00014-75-C-0561 

UNCLASSIFIED  TR-200  .  NL 


MICROCOPY  RESOLUTION  TEST  CHART 


CONSTRUCTING  A  MINIMAL  COST  SPANNING  TREE 
SUBJECT  TO  RESOURCE  CONSTRAINTS  AND  FLOW  REQUIREMENTS 


by 


Andrew  W.  Shogan 


TECHNICAL  REPORT  NO.  200 
November  1981 


SUPPORTED  UNDER  CONTRACT  N00014-75-C-0561  (NR-047-200) 
WITH  THE  OFFICE  OF  NAVAL  RESEARCH 


Gerald  J.  Lieberman,  Project  Director 


Reproduction  In  Whole  or  In  Part  Is  Permitted 
for  any  Purpose  of  the  United  States  Government 


Approved  for  public  release;  distribution  unlimited 


DEPARTMENT  OF  OPERATIONS  RESEARCH 
AND 

DEPARTMENT  OF  STATISTICS 
STANFORD  UNIVERSITY 
STANFORD,  CALIFORNIA 


Accession  For 

BTIS  GRAAI 

gf 

DTIC  TAB 

Unannounced 

□ 

Justification _ 

By - - 

Distribution/ 


Availability  Codes 


Dlst 


Avail  and/or 
Special 


CONSTRUCTING  A  MINIMAL  COST  SPANNING  TREE 
SUBJECT  TO  RESOURCE  CONSTRAINTS  AND  FLOW  REQUIREMENTS 

by 

Andrew  W.  Shogan 

University  of  California,  Berkeley 
1 .  INTRODUCTION 

Given  a  connected,  undirected,  N-node  network  with  a  weight  assigned 
to  every  arc,  solving  the  ainiaal  spanning  tree  (MST)  problem  requires  the 
construction  of  a  connected  subnetwork  that  Includes  every  node  of  the  net¬ 
work  and  whose  arcs  have  a  minimal  total  weight*  It  is  well-known  that 
such  a  subnetwork  will  always  be  an  (N-l)-arc  tree,  that  is,  a  connected 
network  with  no  cycles. 

The  construction  of  an  MST  is  the  goal  in  a  wide  variety  of  applica¬ 
tions.  For  example,  given  a  set  of  nodes  that  must  communicate  with  each 
other  and  given  the  cost  of  constructing  a  communication  link  between  each 
pair  of  nodes,  the  MST  is  the  solution  to  the  problem  of  constructing  at 
minimal  cost  a  network  in  which  every  pair  of  nodes  can  communicate  along 
some  path.  A  number  of  other  seemingly  unrelated  problems  and  applications 
can  be  reduced  to  minimal  spanning  tree  problems;  both  Bradley  [1]  and 
Kershenbaum  and  Van  Slyke  [19]  provide  excellent  surveys. 

There  are  two  classic  MST  algorithms,  one  due  to  Rruskal  [20]  and 
another  discovered  Independently  by  Prim  [21]  and  Dljkstra[6].  Both  algo¬ 
rithms  consist  of  N-l  iterations,  with  each  iteration  identifying  a  new 
arc  of  an  optimal  spanning  tree.  An  iteration  of  the  Rruskal  algorithm 
consists  of  adding  an  arc  to  a  forest  of  subtrees;  the  added  arc  is  the  arc 
of  least  weight  that  when  added  to  the  forest  of  subtrees  does  not  form  a 
cycle.  An  Iteration  of  the  Prlm-Dljkstra  algorithm  consists  of  adding  an 
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arc  to  a  single  subtree;  the  added  arc  is  the  arc  of  least  weight  incident 
to  a  node  In  the  subtree  and  a  node  not  In  the  subtree*  Both  algorithms 
are  efficient  and  easy  to  implement  on  a  computer;  Kershenbaum  and  Van 
Slyke  [19] ,  Yao  [24],  and  Cheriton  and  Tarjan  [4]  discuss  very  efficient 
computer  implementations  that  rely  on  sophisticated  sorting  and  storage 
techniques • 

In  many  practical  situations,  resource  constraints  and  flow  require 
ments  preclude  the  construction  of  the  unconstrained  MST  obtained  by  apply 
ing  either  the  Kruskal  or  Prim-Di jkstra  algorithm;  this  paper  considers 
such  a  situation*  More  specifically,  consider  a  set  of  N  nodes  having 
indices  1,  2,  «.«,  N;  node  1  is  a  source  having  an  infinite  supply  of  a 
commodity,  and  every  other  node  p  is  a  sink  having  a  known  constant  de¬ 
mand  dp*  Denote  the  undirected  arc  between  two  nodes  having  Indices 
p  <  q  by  (p»q) ;  note  that  there  are  n  5  (1/2)(N)(N-1)  arcs.  For  nota- 
tional  convenience,  assign  to  each  arc  a  distinct  index  j  equal  to  its 
position  in  a  lexicographic  ordering  of  the  n  arcs  based  on  the  represen 
tatlon  of  an  arc  as  a  vector  (p,q)  with  p  <  q;  that  is,  assign  arc 
(p,q)  the  index  j  -  (l/2)(p-l)(2N-p)  +  (q-p),  where  1  _<  p  <  q  <  N,  so 
that  1  £  j  <_  n.  The  construction  of  the  spanning  tree  requires  the  con¬ 
sumption  of  m  scarce  resources  available  in  supplies  b^  for 
i  -  1,  2,  ...,  m*  Associated  with  each  potential  arc  j  of  the  spanning 
tree  are  m  +  2  known  constants:  cj,  the  cost  of  constructing  arc  j, 
a^j  (1  <  i  <  m),  the  amount  of  resource  1  consumed  during  the  construc¬ 
tion  of  arc  j,  and  ej,  the  flow  capacity  of  arc  j*  (Since  there  exists 
in  any  spanning  tree  a  unique  path  between  the  source  and  a  given  sink, 
ej  is  effectively  an  upper  limit  on  the  summation  of  demands  over  all 
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•inks  whose  unique  paths  to  the  source  Include  arc  j.)  Given  for 

each  sink  p  and  c ^ ,  a^ ,  a^^ ,  ...»  a^,  e^  for  each  arc  j,  the  problea 
is  to  construct  a  ainiaal  cost  spanning  tree  subject  to  the  resource  con¬ 
straints  (i.e.,  the  consuaption  of  each  scarce  resource  cannot  exceed  its 
available  supply)  and  subject  to  the  requireaent  that  there  exists  a  feas¬ 
ible  flow  (i.e.,  a  flow  on  the  arcs  of  the  spanning  tree  that  satisfies  the 
deaands  at  the  sinks  without  exceeding  any  arc  capacity).  Hereafter,  this 
problea  will  be  referred  to  as  the  resource-constrained,  capacitated  aini¬ 
aal  spanning  tree  problea  and  abbreviated  as  the  RCMST  problea. 

Note  the  following  charscteristlcs  of  the  RCMST  problea: 

(1)  It  is  assuaed  that  between  any  pair  of  nodes  there  exists  only 
one  arc  under  consideration  for  inclusion  in  the  spanning  tree; 
Section  5  relaxes  this  assumption  in  order  to  consider  the  case 
where  any  one  of  multiple  arcs  between  a  pair  of  nodes  is 
eligible  for  inclusion  in  the  spanning  tree. 

(2)  If  for  soae  arc  J,  cj  -  -,  a1;j  >  b*  for  soae  i,  or 
ej  ■  0,  then  arc  j  aay  be  excluded  froa  consideration. 

(3)  The  constants  cj,  a*j  for  i  -  1,  2,  ...,  a,  and  ej 

for  soae  arc  j  aay  be  Interrelated;  for  exaaple,  a  portion  of 
the  construction  cost  Cj  aay  be  attributable  to  the  costs 
of  the  scarce  resources  constaed  and/or  the  aagnitude  of  the 
capacity  or,  for  exaaple,  one  of  the  resource  constraints  aay 
Halt  the  number  of  arcs  of  a  given  capacity  that  aay  be  in¬ 
cluded  in  the  spanning  tree. 


(4)  Bach  reaource  constraint  need  not  represent  a  resource  in  the 
strict  sense  of  the  word.  Por  exaaple,  by  setting  a^j  -  1 


if  arc  j  is  incident  to  node  1  and  a^j  “  0  otherwise, 
the  i-th  resource  constraint  nay  be  used  to  require  the  degree 
of  node  i  in  the  spanning  tree  to  be  no  greater  than  some 
constant  b^;  hereafter,  such  a  resource  constraint  will  be 
referred  to  as  a  "degree  constraint”. 

(5)  If  the  denands  dp,  2  <  p  <  N,  all  equal  1,  then  an  arc 

capacity  ej  (1  <  j  <  n)  may  be  Interpreted  as  the  maximum 
number  of  nodes  that  may  access  the  source  through  arc  j  if 
it  were  to  be  included  in  the  spanning  tree.  For  example. 


e^  •  K  for  any  arc  j  incident  to  the  source  and  e ^  • 

otherwise  models  the  situation  where  at  most  K  nodes  (e.g. 


computer  terminals)  may  be  contained  in  any  subtree  connected 
directly  to  the  source  (e.g.,  a  central  computer)  by  arc  j 
(e.g.,  a  port).  As  another  example,  ej  ■  K  for  every  arc 
j  models  a  "reliability  constraint"  stating  that  at  most  K 
demand  nodes  may  be  disconnected  from  the  sink  by  the  removal 


(failure)  of  any  arc  from  the  spanning  tree. 

(6)  Requiring  the  constructed  network  to  be  a  tree  implies  that 
there  are  reasons  (perhaps  physical  or  technological)  that 
prevent  the  flow  from  the  source  to  a  particular  sink  to  be 
transmitted  simultaneously  along  more  than  one  path. 


In  its  most  general  form,  the  RCMST  problem  has  not  yet  been  dis¬ 
cussed  in  the  literature;  neither  has  the  special  case,  hereafter  referred 


to  as  the  Resource-constrained  Minimal  Spanning  Tree  (RMST)  problem,  in 
which  ej  «  •  for  every  arc  j  (l.e.,  the  flow  constraints  may  be  ig¬ 


nored  so  that  only  the  resource  constraints  are  present).  However,  two 


•pedal  cases  of  the  RCMST  problems  have  received  significant  attention  by 
other  researchers:  (1)  the  Degree-constrained  Minimal  Spanning  Tree  (DMST) 
problem  in  which  ej  «  •  for  every  arc  j  and  in  which  all  resource 
constraints  are  “degree  constraints"  as  described  earlier  and  (2)  the 
Capacitated  Minimal  Spanning  Tree  (CMST)  problem  in  which  ■  •  for 
every  resource  1  (i.e.,  the  resource  constraints  may  be  ignored  so 

that  only  the  flow  constraints  are  present).  Both  the  DMST  and  the  CMST 
problems  are  known  to  be  NP-hard;  consequently,  most  approaches  to  these 
problems  have  been  heuristic  rather  than  exact.  Kershenbaum  [18]  has  sur¬ 
veyed  and  analyzed  the  computational  complexity  of  a  class  of  heuristic 
algorithms  for  the  CMST  problem;  Chandy  and  Lo  [3]  have  proposed  a  branch- 
and-bound  algorithm  for  obtaining  the  exact  solution  to  the  CMST  problem; 
and,  more  recently,  Gavlsh  [11,  12]  has  proposed  a  Lagrangean-based 
approach  to  both  the  DMST  and  CMST  problems. 

The  remainder  of  this  paper  is  organized  as  follows.  Section  2  dis¬ 
cusses  applications  of  the  RCMST  problem;  Section  3  describes  a  branch-and- 
bound  algorithm  (based  on  Lagrangean  relaxation)  for  solving  the  RMST  prob¬ 
lem  and  illustrates  the  algorithm  with  an  example;  Section  4  discusses  the 
modifications  to  the  algorithm  necessary  to  solve  the  more  general  RCMST 
problem;  Section  5  discusses  further  modifications  necessary  to  solve  two 
extensions  of  the  RCMST  problem,  the  existence  of  multiple  arcs  between  a 
pair  of  nodes  and  the  existence  of  multiple  sources;  finally.  Section  6 
reports  some  preliminary  computational  experience  with  a  computer  implemen¬ 
tation  of  the  algorithm. 

In  the  remainder  of  this  paper,  the  following  conventions,  notation, 
and  terminology  will  apply: 
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(1)  all  vectors  sr«  row  vectors; 

(2)  c  will  denote  •  vector  whose  J-th  component  Is  cj,  the 
cost  of  constructing  arc  J; 

(3)  whenever  "0"  Is  used  where  a  vector  would  normally  appear,  it 
represents  a  vector  with  every  component  equal  to  0; 

(4)  If  x  -  (Xj,  ...»  xn),  then  Ixl  -  x*; 

(5)  If  x  and  y  are  two  vectors  having  the  sane  dimension,  xy 

represents  the  product  of  x  and  y,  where  it  is  Implicitly 

assumed  that  y  has  been  transposed  so  that  the  product  is 
defined; 

(6)  if  x  and  y  are  two  vectors  having  the  same  dimension, 

max  (x,y)  represents  a  vector  whose  i-th  component  is  the 
maximum  of  the  1-th  component  of  x  and  the  i-th  component 
of  y; 

(7)  if  A  and  B  are  two  sets,  A-B  denotes  the  intersection  of 

A  and  the  complement  of  B,  that  is,  the  set  of  elements  in  A 
but  not  in  B; 

(8)  the  existence  of  a  '‘feasible  flow"  in  a  tree  implies  that  there 
exists  a  flow  on  the  arcs  of  the  tree  such  that  the  flow  on  any 
arc  does  not  exceed  the  arc's  capacity  and  the  difference 
between  the  flow  out  of  a  node  and  the  flow  into  a  node  equals 
the  node's  supply  if  it  is  a  source,  the  negative  of  the  node's 
dasttnd  if  it  is  a  sink,  and  sero  otherwise. 


2.  APPLICATIONS 


The  RCMST  problea  has  applications  to  the  design  and  construction  of 
a  tree  network  in  which  a  set  of  demand  nodes  and  a  single  source  oust  be 
Interconnected  by  selecting  from  a  set  of  potential  arcs,  each  having  an 
associated  capacity  and  resource  consumptions*  Por  example,  the  demand 
nodes  may  be  computer  terminals,  the  source  may  be  a  central  computer,  and 
the  arcs  nay  be  potential  transmission  lines  (cf.  [3],  [12],  and  [18]); 
alternatively,  the  demand  nodes  may  be  offshore  natural  gas  fields,  the 
source  may  be  an  onshore  separation  and  compression  plant,  and  the  arcs  may 
be  potential  pipelines  (cf.  [22]). 

Although  the  RCMST  problem  has  applications  to  the  design  and 
construction  of  spanning  trees,  the  primary  motivation  for  consideration  of 
the  RCMST  problem  was  the  problem  of  reconstructing  a  network  after  a 
natural  disaster,  such  as  an  earthquake.  Cities,  states,  and  countries 
rely  heavily  on  a  variety  of  networks:  energy  networks  (such  as  electrical 
or  natural-gas  networks),  communication  networks  (suah  as  telephone, 
telegraph,  or  computer  networks),  transportation  networks  (such  as  highway 
or  railroad  networks),  and  water  networks  (such  as  networks  for  the 
distribution  of  potable  water  or  the  removal  of  sewage).  Using  an  analogy 
with  the  human  body's  life-supporting  "networks"  (e.g.,  the  vascular  and 
neurological  systems),  C.M.  Duke  and  D.  F.  Moran  [7]  coined  the  term 
"lifelines"  to  refer  to  such  networks,  and  their  analysis  and  recommenda¬ 
tions  following  the  1971  San  Fernando  (California)  earthquake  lead  to  an 
increased  emphasis  by  professionals  and  academicians  on  the  problems  of 
"lifeline  earthquake  engineering".  In  the  last  10  years,  much  research  has 
been  devoted  to  predicting  the  level  of  damage  a  particular  lifeline  might 


sustain  in  an  earthquake  and  to  designing  new  lifelines  and  "retrof lttlng” 
existing  lifelines  to  Halt  the  potential  damage  as  auch  as  possible. 
However,  not  nearly  as  auch  effort  has  been  devoted  to  the  decision 
problems  associated  with  optimally  restoring  the  services  provided  by  a 
lifeline  that  has  been  damaged  by  an  earthquake.  Restoration  of  service  is 
an  laportant  problea  If  one  accepts  the  fact  that  in  certain  regions  of  the 
world,  earthquakes  and  the  resulting  daaage  to  lifelines  are  inevitable. 

Many  important  lifelines  do  not  have  a  tree  structure,  and,  after 
sustaining  damage,  the  long-run  goal  for  such  a  network  will  be  to  rebuild 
the  network  so  that  it  is  as  good  or  better  than  it  was  prior  to  the 
earthquake.  However,  the  short-run  goal  aay  be  less  aabltious.  In  the 
short-run,  the  goal  aay  simply  be  to  allocate  scarce  resources  (labor, 
equipment,  spare  parts,  etc.)  to  the  repair  process  in  such  a  way  as  to 
restore  soae  "minimal  level  of  service"  as  quickly  and  economically  as 
possible.  One  possible  interpretation  of  "minimal  level  of  service"  is 
that  the  short-run  goal  would  be  to  construct  a  spanning  tree  (when  only  a 
single  source  exists)  or  a  spanning  forest  (when  multiple  sources  exist)  so 
that  every  demand  node  would  have  access  to  a  source.  Stated  more  formally 
in  the  context  of  the  RCMST  problem,  suppose  that  the  short-run 
post-earthquake  goal  for  a  damaged  network  is  to  construct  a  minimal  cost 
spanning  tree  by  repairing  a  sufficient  number  of  arcs.  The  restoration  of 
arc  j  (1  <.  j  £  n)  to  its  former  capacity  ej  would  cost  cj  dollars 
and  would  consume  a± j  (1  <  i  <  m)  units  of  the  limited  quantity  of 
bj  units  of  resource  1.  The  extensions  discussed  in  Section  5  are 
applicable  if  it  is  possible  to  repair  an  arc  in  a  variety  of  ways,  with 
each  way  having  a  distinct  associated  cost,  capacity,  and  consumption  of 
resources  and/or  if  there  exist  multiple  sources. 
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3.  SOLVING  THE  KMST  PROBLEM 


Let  x  denote  a  binary  vector  whose  j-th  component  xj  equals 
1  if  arc  j  is  Included  in  the  spanning  tree  and  equals  0  otherwise; 
hereafter,  such  an  x  will  be  referred  to  as  an  incidence  vector.  Edmonds 
[8]  has  shown  that  x  is  an  Incidence  vector  corresponding  to  a  tree  if 
and  only  if  x  is  an  extreme  point  of  the  feasible  region  of  a  finite  but 
very  large  system  of  linear  Inequalities;  hereafter ,  x  €  T  will  denote 
that  xj  *  0  or  1  for  1  _<  j  _<  n  and  x  also  satisfies  Edmonds' 
system  of  linear  inequalities ,  or  equivalently ,  x  is  an  incidence  vector 
corresponding  to  a  tree. 

The  RMST  problem  can  now  be  formulated  as  the  following  binary 
Integer  linear  program; 

(P)  Minimise  c,x. 

subject  to  aijXj  -  h  for  1  £  i  < 

and  x  €  T. 

Were  it  not  for  the  m  resource  constraints,  (P)  would  simply  be  a 
classic  MST  problem  and  could  be  easily  solved  by  either  of  the  algorithms 
discussed  in  Section  1.  However,  the  presence  of  the  resource  constraints 
precludes  an  easy  solution  of  (P). 

Using  one  of  the  binary  integer  linear  programming  algorithms  to 


solve  (P)  is  impractical  due  to  the  unmanageable  size  of  the  system  of 
linear  inequalities  represented  by  x  c  T.  Instead,  the  approach  taken  in 


this  paper  will  be  to  solve  (P)  by  a  branch-and-bound  algorithm  based  on 
the  technique  of  Lagrangean  relaxation. 

Fisher  [9],  Shapiro  [23],  Fisher,  Northup,  and  Shapiro  [10],  and 
Geoffrion  [13]  have  all  written  excellent  surveys  of  Lagrangean 
relaxation.  The  technique  was  applied  first  in  1970  and  1971  by  Held  and 
Karp  [14,  15]  in  their  highly  successful  branch-and-bound  approach  to  the 
traveling  salesman  problem.  Held  and  Karp  used  a  variant  of  a  tree  called 
a  1-tree,  defined  as  a  network  consisting  of  N  nodes  and  N  arcs  and 
obtained  by  connecting  node  1  to  any  two  nodes  in  a  spanning  tree 
interconnecting  nodes  2,  3,  N.  Thus,  a  1-tree  always  has  one  and 

only  one  cycle,  this  cycle  always  contains  node  1,  and  node  1  always  has 
degree  two.  Also,  note  that  a  minimum-cost  1-tree  can  be  efficiently 
found  by  constructing  a  minimum-cost  spanning  tree  interconnecting  the 
nodes  2,  3,  ...,  N  and  then  connecting  node  1  to  the  tree  by  the  two 
arcs  incident  to  node  1  having  the  lowest  cost.  Upon  observing  that  a 
tour  for  the  traveling  salesman  is  simply  a  1-tree  in  which  each  node  has 
degree  two,  Held  and  Karp  formulated  the  traveling  salesman  problem  as  the 
minimum-cost  1-tree  problem  subject  to  the  additional  constraints  that 
each  node  has  degree  two.  The  formulation  is  similar  to  that  of  (P)  with 
T  modified  slightly  to  take  into  account  that  x  should  correspond 
to  a  1-tree  and  the  resource  constraints  replaced  by  linear  equations 
requiring  each  node  to  have  degree  two.  Held  and  Karp  solved  their 
degree-constrained  minimum-cost  1-tree  problem  by  developing  a 
branch-and-bound  algorithm  that  for  the  first  time  used  the  concept  of 
Lagrangean  relaxation.  Subsequent  to  the  pioneering  work  of  Held  and  Karp, 


many  applications  of  Lagrangean  relaxation  have  appeared  in  the 
literature*  Fisher  [9]  provides  an  excellent  survey  and  a  comprehensive 
bibliography* 

The  discussion  to  follow  of  the  branch-and-bound  algorithm  used  to 
solve  (P)  will  employ  the  standard  terminology  (cf.  [17,  pp.  716-718). 

In  particular,  at  any  point  in  the  algorithm,  let  Z denote  the  objective 
value  of  the  incumbent,  the  best  known  feasible  solution  of  (P);  unless  a 
feasible  solution  is  known  at  the  start,  Z^  is  initially  set  to 

It  is  helpful  to  think  of  the  algorithm  as  producing  a  rooted  tree 
(hereafter  referred  to  as  the  b&b-tree  in  order  to  distinguish  it  from  a 
spanning  tree) ,  where  the  root  of  the  b&b-tree  corresponds  to  problem 
(P).  Every  other  node  of  the  b&b-tree  corresponds  to  a  problem  similar  to 
(P)  but  having  added  restrictions  placed  on  the  incidence  vector  x  .  In 
particular,  associated  with  each  node  of  the  b&b-tree  are  two  mutually 
exclusive  subsets  A  and  B  of  the  set  of  arc  indices  (1,  2,  •*.,  n}; 
the  subset  A  consists  of  indices  of  arcs  that  not  only  form  a  subtree  but 
also  must  be  "admitted"  to  the  spanning  tree  (x  -  1  for  j  €  A),  and  the 

J 

subset  B  consists  of  indices  of  arcs  that  must  be  "banished"  from  the 
spanning  tree  (x^  *  0  for  j  €  B)*  Given  its  associated  A  and  B,  a 
node  of  the  b&b-tree  corresponds  to  the  binary  integer  linear  program 

(P^)  Minimize  c  .x, 

subject  to  aij*J  -  ^1  for  1  Si  1  S.  *  » 

and  x  «  , 
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where  •  T  n  {xjxj  ■  1  for  J  e  A)  n  {x|xj  “  0  for  j  «  B). 

Because  c  x,  problea  (P^)  will  be  referred  to  as  a  "subproblea"  of 

problea  (P).  At  any  stage  of  the  branch-and-bound  algorithm,  the  T._ 

Ad 

sets  associated  with  the  leaves  of  the  b&b-tree  are  a  partition  of  T;  in 

this  sense,  then,  the  subprobleas  (P  )  associated  with  the  leaves  of  the 

AB 

b&b-tree  are  a  ‘’partition"  of  the  problea  (P). 

The  Lagrangean  relaxation  (L-relaxatlon  hereafter)  of  problea  (P^g) 
relative  to  the  a  resource  constraints  and  a  given  nonnegative  dual 
vector  X  ■  (X^,  ,  . . . ,  X^)  is  the  binary  integer  linear  program 


(P^)  Minimize 

subject  to 
or,  equivalent ly, 
Minimize 
subject  to 


ij-i  cfi  *  i*-i  ‘U  *j  -  V 

x  e  T, 


AB’ 


^J-l  (cj  +  ^i-1  Xi*ij)xj  ~  ^i-1  \bi 


x  e  T 


AB 


Note  that  for  a  given  nonnegative  X,  (pj^)  is  equivalent  to  an  MST 
problea  where  the  weight  associated  with  arc  j  is  -*  if  j  e  A,  •  if 
J  e  B,  and  (c ^  X^a^, )  otherwise.  As  such,  (P^)  aay  be  solved 

easily  by  any  of  the  MST  algorithms  discussed  in  Section  1. 

For  a  given  A  and  B  and  any  nonnegative  X,  let  v^  and 
Wgg(X)  denote  the  optiaal  objective  values  for  probleaa  (P^)  and 
(P^g),  respectively.  Clearly,  w^(  X)  £  v^;  that  is,  w^g(  X)  is  a  lower 
bound  on  vjj  for  any  nonnegative  A.  A  traditional  branch-and-bound 
approach  alght  use  w^g(O)  as  a  lower  bound  for  vjj,  that  is,  compute  a 
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lower  bound  on  by  simply  Ignoring  the  resource  constraints  and 

solving  the  resulting  minimal  spanning  tree  problem.  However,  a  branch- 
and-bound  algorithm  based  on  L-relaxatlon  seeks  to  Increase  the  likelihood 
of  fathoming  a  subproblem  (P  )  by  searching  for  the  greatest  possible 
lover  bound  by  considering  the  following  dual  problem  of  (Pab). 

(D^)  maximize  w^(  X) 

subject  to  X^  0  for  l  <.  1  £  m  . 

Note  that  although  problem  (1>ab)  will  be  referred  to  as  the  dual  of 
problem  (Pab)»  a  "duality  gap”  (cf.  [10,  p.  57]  or  [13,  p.  87])  may  be 
present;  that  Is,  the  optimal  objective  value  for  (Dab)  nay  be  strictly 
less  than  the  optimal  objective  value  for  (Pab)*  Also,  as  Indicated  In 
the  discussion  below  of  the  branch-and-bound  algorithm,  there  are  other 
potential  benefits  to  considering  (Dab)  in  addition  to  an  Increased 
likelihood  of  fathoming  a  subproblem  (Pgg)  based  on  a  lower  bound  on 
Its  optimal  objective  value.  In  particular,  instead  of  simply  solving 
(Pj_)  as  a  more  traditional  approach  might  do,  the  attempt  to  solve  (D._) 
involves  the  solution  of  a  series  of  problems  of  the  form  (P^g)  with  a 
different  value  of  k  each  time;  this  Increases  the  likelihood  of 
fathoming  the  subproblem  (Pab)  because  each  solution  of  a  particular 
(P^g)  may  result  in  one  or  more  of  the  following  possibilities: 

(1)  an  increased  lower  bound  on  the  optimal  objective  value  of 
(?ab), 

(2)  a  decrease  in  the  objective  value  of  the  incumbent, 
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(3)  the  optimal  solution  to  (Pgg) * 

Note  that  possibility  (2)  also  may  lead  to  the  fathoming  of  other 

subproblems  besides  the  particular  (Pgg)  under  consideration. 

Figure  1  contains  a  flow  chart  of  the  branch-and-bound  algorithm;  a 

more  detailed  discussion  of  each  of  the  steps  follows.  As  indicated 
* 

earlier,  for  a  given  A  and  B  and  any  nonnegative  X,  w*  (X)  denotes 

AB 

the  optimal  objective  value  for  problems  (P^  );  also,  let  x*  (X)  denote 

AB  AB 

an  optimal  Incidence  vector  for  (P*_  )  and  let  a*  ( X)  denote  an 

AB  AB 

m-vector  whose  i-th  component  is  the  value  of  -  2,j_i  aijxj  evaluate^ 

at  x  -  x*  (X),  that  is,  the  value  of  the  slack  variable  for  the  i-th 
AB 

resource  constraint  when  evaluated  at  the  optimal  solution  to  (P^  ). 

AB 

Steps  1,  2,  and  10:  The  stack  is  a  list  of  unfathomed  subproblems. 

A  subproblem  (Pab)  on  the  ®*ack  1®  characterized  by  a  "vector  of 

Information"  [A,B,X,w^(X),s*g(X)],  where  X  is  not  necessarily  the 

optimal  solution  to  problem  (D  )  but  is  such  that  w*  (X)  is  the 

AB  AB 

greatest  known  lower  bound  on  v*_.  Initially  (Step  1),  the  stack  contains 
“  AB 

a  single  subproblem  [♦,  b.O.w*  (0),s*  (0)]  corresponding  to  solving  the 

99  99 

0 

minimal  spanning  tree  problem  (P.  .)  that  results  from  ignoring  the 

99 

resource  constraints  in  problem  (P.  .)  »  (P).  When  the  stack  contains  more 

99 

than  one  item,  it  is  helpful  to  think  of  items  on  the  stack  as  being 
ordered  from  the  top  to  bottom  in  increasing  magnitudes  of  the  lower  bound 
v^b(X).  In  selecting  a  new  subproblem  from  the  stack  (Step  2),  the  chosen 
subproblem  is  the  one  with  the  lowest  lower  bound  w*  (X),  that  is,  the 
subproblem  on  the  top  of  the  stack*  Of  course,  if  the  stack  is  empty  (Step 
10),  all  subproblems  have  been  fathomed  and  the  Incumbent  incidence  vector 
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Is  the  opt leal  solution  to  (P);  actually,  since  It  Is  not  unusual  for  the 

Incumbent  to  change  after  a  subproblea  has  been  placed  on  the  stack,  a 

non-empty  stack  should  be  emptied  by  the  fathoming  of  the  entire  stack 

whenever  the  Item  on  the  top  of  the  stack  has  a  lower  bound  w*  (X) 

AB 

greater  than  or  equal  to  the  Incumbent's  objective  value. 

Overview  of  Steps  3-6:  Upon  the  selection  of  a  subproblem  (Pgg) 

characterized  by  the  "vector  of  information"  [A,B,X,w*  (X),  s*  ( X) ] ,  an 

AB  AB 

attempt  is  made  to  solve  the  problem  (Dab) *  Because  of  the  work  of 

Edmonds  [8]  discussed  earlier  in  this  section,  problem  (P^_  )  has  the 

Integrality  Property  of  Geoff rion  [13,  p.  89];  hence,  the  optimal  solution 

to  problem  (Dab)  may  be  obtained  in  principle  as  the  optimal  dual 

variables  associated  with  the  resource  constraints  of  the  linear  program 

that  results  from  replacing  »  0  or  1"  with  "0  <  xj  <  1" 

(1  <  j  <  n)  in  the  binary  Integer  linear  program  (Pab)*  However, 

solving  (&ab)  *n  8uch  a  manner  is  impractical  due  to  the  large  number 

of  linear  inequalities  represented  in  (P^b)  by  x  €  Tab;  Hence,  an 

attempt  to  solve  (Dab)  will  be  made  through  an  iterative  procedure 

(Steps  3-6)  known  as  subgradient  optimization  (cf.  [9],  [10],  [13],  and 

[16] ).  Subgradient  optimization  is  so  named  because  -s* (X)  is  a  sub- 

AB 

gradient  of  the  objective  function  for  (DA  )  at  the  point  X,  and  the 

procedure  optimistically  uses  this  subgradient  as  if  it  were  a  gradient 

pointing  In  a  direction  of  steepest  ascent#  Iteration  k  of  subgradient 

optimization  consists  of  the  following  steps: 

k  k-I 

(3)  movement  to  a  new  dual  vector  X  obtained  recursively  from  X  ,  (4») 
solution  of  the  L-relaxatlon  (P^),  (5)  attempting  to  fathom  the 
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X 

subproblem  (P^)  based  on  the  results  of  solving  (P^) ,  and  (6) 
deciding  whether  to  perform  another  Iteration  if  the  fathoming  attempt  was 
unsuccessful*  The  hope  is  that  the  sequence  {X  }  will  yield  a  good 
suboptimal,  If  not  an  optimal  solution  of  (D^g)*  Each  step  of 
subgradient  optimization  will  now  be  discussed  In  detail* 

Step  3:  The  revision  of  the  dual  vector  X  Is  the  most  complicated 
procedure  In  the  branch-and- bound  algorithm.  The  procedure  is  based  on  a 
proof  (omitted  here  but  contained  In  [15]  and  [16])  that  If  the  nonnegative 
scalar  6^  Is  sufficiently  small ,  then 

\k  s  max  [O.X*"1  -  ©k  s^X*'1)] 

is  closer  than  X^~l  (as  measured  by  Euclidean  distance)  to  the  optimal 
solution  of  (D  ),  although  w^  (Xk)  >  w*  (Xk  *)  need  not  hold.  The 
complication,  then,  lies  in  the  choice  of  ®k;  Held  and  Karp  [15] 
successfully  used  ©^  »  1  for  all  k  in  their  work  on  the  traveling 
salesman  problem,  and  Held,  Wolfe,  and  Crowder  [16]  later  validated  a  more 
general  method  for  choosing  a  value  for  ©fc.  (Those  readers  not 
Interested  in  further  detail  on  the  procedure  for  revising  X  should  skip 
to  the  discussion  of  Step  4.)  Actually,  the  procedure  used  for  revising  X 
in  the  computer  implementation  of  the  branch-and-bound  algorithm  discussed 
in  Section  6  is  a  generalisation  of  the  above  expression  for  \k  that  is 
due  to  Camerinl,  Pratta,  and  Maffloll  [2]  and  Crowder  [5].  For 
completeness,  the  procedure  is  now  summarised  without  justification.  Given 
a  subproblem  (P^g)  characterised  by  the  "vector  of  information" 


0;  the 


,  set  X®  -  X  and  set  the  a-vector  d^  - 
sequence  of  dual  vectors  {XM  Is  generated  by  the  recursions 


dk  “  -  <»<xkrl>  +  e*""1 


1  if  z. 


ZT  -  w*  (Xk-1) 


L  a  II - _ 


if  Zt  < 


,k  r  _k-l  .  .  ki 

X  ■  max  [0,X  +  ®vd  J  » 


where  P  is  a  known  nonnegative  constant  (0  -  0.6  in  the  computational 
experience  discussed  in  Section  6)  and  (a^)  is  a  predetermined  sequence 
of  nonnegative  scalars  generated  according  to  the  following  policy  (c.f. 
[9,  p.  8),  [16,  p.  68]  and  [5,  p.  361]):  (1)  set  <*k  -  2  for  2N 
iterations,  where  N  is  the  number  of  nodes  in  the  network,  (2)  then 
successively  halve  both  the  value  of  <*k  and  the  number  of  iterations 
o<k  remains  constant  until  the  number  of  iterations  is  less  than  5,  (3) 
thereafter,  is  halved  every  5  iterations.  Note  that  the  above 

expression  for  d^  can  be  expanded  to  yield 

dk  -  -  -  P«2B(^k"2)  “  P2*JB(Xk_3)  ~  •••  -  pk"1sJB(X°) 

so  that  the  direction  of  movement  away  from  X^-!  is  a  discounted 
composite  of  the  current  and  previous  slack  vectors  (subgradients). 
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Step  4:  Given  the  revleed  dual  vector  X,  (P^)  is  equivalent  to 
an  MST  problea  where  the  weight  associated  with  arc  j  is  -•  if  j  c  A, 
•if  J  e  B,  and  (c^  +  \*ij^  otherwise.  As  discussed  in  Step  7 

below,  the  arcs  whose  indices  are  in  A  fora  a  subtree.  Hence,  (P^g)  nay 
be  solved  efficiently  by  first  foralng  the  subtree  of  "adaitted"  arcs  and 
then  continuing  with  the  Prin-Dl jkstra  algor itha  as  described  by  Prla  [21] . 


Step  5:  Upon  solving  (P^g),  *n  atteapt  is  aade  to  fathoa  the 

subproblea  (Pgg),  that  is,  to  reaove  the  subproblea  froa  further 

consideration.  As  indicated  by  the  flowchart  contained  in  Figure  2,  the 

fathoning  subroutine  consists  of  the  four  steps  A,  B,  C,  and  D.  In  Step 

A,  a  check  is  aade  on  whether  (1+e)  w*  (X)  >  Z  holds,  where  100c  is 

AB  X 

the  given  percentage  error  tolerance  (e  -  0.00,  0.01,  or  0.05  in  the 

coaputatlonal  experience  discussed  in  Section  6).  With  w*  (X)  being  a 

AB 

lover  bound  on  v*  ,  If  (l+e)v*  (X)  >  Z  holds ,  then  the  subproblea  can 
Ad  AB  '  X 

be  fathoaed  since  100c  is  the  aaxlaua  percentage  error  that  could  result 

if  the  optiaal  incidence  vector  for  problea  (P)  belonged  to  the  feasible 

region  of  (P^g) .  If  (l+c)w*w( X)  <  Z the  fathoning  subroutine  proceeds 

to  Step  B  where  a  check  is  aade  on  whether  x*  (X)  is  a  feasible  for 

AB 

(P AB)  and  therefore  (P),  that  is,  on  whether  the  ainlnal  spanning  tree 

for  (P^)  also  satisfies  the  resource  constraints  of  (P).  The 

feasibility  check  is  easily  aade  by  checking  for  a  strictly  negative 

coaponant  in  the  slack  vector  a*  (X);  if  a*  (X)  >  0  does  not  hold,  the 

AB  AB 

fathoming  subroutine  ends  with  (P^)  unfathoaed;  if  s^tX)  >  0,  the 
fathoming  subroutine  proceeds  to  Step  C  in  order  to  update  the  incuabent  if 
necessary.  More  specifically, 


wIb(X)  -  cxIb(X)  -  *1*™  <  ZI 


holds  since  (Par)  vai  not  fathoaed  in  Step  A;  however, 


C<B(X)  "  ^<X>  +  *1*™  <  ZI 


need  not  hold.  Given  the  verification  In  Step  B  of  the  feasibility  of 

x*  (X)  for  problem  (P),  If  cx*  (X)  <  Z  does  hold,  then  x*  (X) 

Ad  AB  1  AB 

becomes  the  new  Incumbent;  otherwise,  the  Incumbent  remains  unchanged. 
Regardless  of  the  outcome  of  Step  C,  Step  D  makes  another  attempt  to  fathom 
(Pab).  In  particular* 


*i.<x> 


- 


x*»<x>  *  *  “«<x> 


where  the  last  Inequality  follows  from  the  verification  in  Step  B  of  the 

feasibility  of  x*  (X)  for  problem  (P  );  hence,  If  complementary 
AD  AB 

slackness  holds,  that  is,  if  Xa*  (X)  -  0,  then  w*  (X)  -  v*  -  cx*  (X)  so 

AB  AB  AB  AB 

that  X  and  x*  (X)  are  optimal  solutions  to  problems  (D  )  and  (P  ), 
AB  AB  AB 

respectively.  Actually,  if  Xa^X)  <  e  w^fX),  subproblem  (P^)  can  be 

fathomed  since  lOOe  is  the  maximum  percentage  error  that  could  result  by 

assuming  x*  (X)  Is  the  optimal  solution  to  (P  ).  Mote  that  If 
AB  AB 

subproblem  (P^)  is  fathomed  In  Step  D,  then  x*w(  X)  will  always  have 
Just  become  the  new  Incumbent  In  Step  C  since 


cx^B(X)  -  w^X)  +  Xa^CX)  <  (l+c)w^(X)  <  Zj  , 
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where  the  first  Inequality  follows  because  Xs*  (X)  £  t  w*  (X)  and  the 

AB  AB 

second  Inequality  follows  from  the  fact  that  (P .  _)  was  not  fathomed  in 

AB 

Step  A* 


Step  6:  If  the  subproblem  (PA_)  was  not  fathomed  in  Step  5,  a 

AB 

decision  must  be  made  as  to  whether  to  continue  with  subgradient 

0  12  k 

optimization*  Let  X  ,  X  ,  X  ,  •  ••,  X  denote  the  dual  vectors  generated 

during  the  first  k  Iterations  of  subgradient  optimization*  Recall  that 

w^X1),  ^(X2),  •••»  w^j(X^)  need  not  be  a  nondecreasing 

sequence;  hence #  it  is  necessary  during  subgradient  optimization  to 

initialize  and  update  an  Incumbent  dual  vector  X*,  that  is,  that  vector 

among  X°,  X1 ,  X2 ,  . X^  that  produces  the  greatest  lower  bound  on  v*  . 

AB 

A  (kfl)-st  Iteration  of  subgradient  optimization  is  performed  unless  one 

of  the  following  two  situations  occur:  (1)  k  >  4N,  where  N  is  the  number 

of  nodes  in  the  network,  or  (2)  within  the  5  most  recent  iterations, 

w*  (X1)  has  not  increased  by  at  least  0.1Z. 

AB 

Steps  7,  8  and  9:  After  an  unsuccessful  attempt  to  fathom  the 

subproblem  via  subgradient  optimisation,  (P  )  must  be  partitioned  into 

AB 

two  subproblems.  Safer  to  the  set  of  arcs  whose  indices  are  in  A  as  the 
"A-arca“ .  Assume  inductively  that  (if  A  *  ♦)  the  A-arcs  form  a  aubtree 
and  that  at  least  one  of  the  arcs  of  the  subtree  is  incident  to  the  source; 
hereafter,  this  subtree  will  be  referred  to  as  the  A-subtree .  If  A  *  ♦, 

let  J  denote  the  set  of  arc  indices  such  that  J  c  J  if  and  only  if 

AB  AB 

j  4  B  and  one  of  the  two  nodes  which  arc  J  is  incident  is  a  member  of 

the  A-subtree  and  the  other  node  is  not;  if  A  *  ♦,  let  J  equal  the 

AB 


Indices  of  those  arcs  not  In  B  but  incident  to  the  source.  Also,  let  j* 

denote  the  Index  that  minimizes  c j  +  ^iaij  over  J  <  (recall  X* 

is  the  incumbent  dual  vector  after  subgradient  optimization).  Then, 

partition  (P.«)  into  the  two  subproblems  (P  .  )  and  (P  .  ^  ). 

AB  Au{j*},B  A,BU{J*> 

Note  from  the  inductive  hypothesis  and  the  definition  of  J* ,  that  the 
Au { j*  }-arc8  form  a  subtree  and  at  least  one  of  the  arcs  in  the  subtree  is 
incident  to  the  source.  Note  also  that  j*  is  simply  the  index  of  the  arc 

that  connects  the  subtree  corresponding  to  A  (node  1  if  A  ■  ♦)  to  its 
closest  neighbor  as  measured  by  the  objective  function  coefficients  of 

(*j|j  *  )  in  problem  (P^)»  that  is,  j*  was  the  index  of  the  first 

arc  added  to  the  A-subtree  when  the  Prim-Di jkstra  algorithm  was  used 

during  subgradient  optimization  to  solve  the  MST  problem  (P^_ ) . 

AJ> 

Consequently,  (P^1  )  and  (P^1)  have  the  same  optimal  solution 

Au{j*),B  AB 

so  that  (p  ,  ),  in  the  form  of  the  "vector  of  information" 

Au{j*},B' 

[Au{j* },B, X*,w*  (^I),s*  (X*)] ,  should  be  added  to  the  stack  of  unfathomed 
AB  AB 

subproblems  unless  fathoming  is  possible  due  to  the  occurrence  of  one  of 
the  following  situations: 

(1)  The  amount  of  a  particular  resource  used  by  the  "admitted” 

Au { j*  ^-subtree  already  exceeds  the  supply  available  for  the  entire  spanning 

tree;  that  is,  I  ,  **  ^  >  b, .  In  such  a  case,  (P  ,  )  can  be 

j€Au{j*}  ij  i  Au{  j*},  B 

fathomed  because  it  has  no  feasible  solution. 

(2)  Situation  (1)  has  not  occurred  but  Au{j*}  contains  N-l 
indices,  where  N  is  the  number  of  nodes  in  the  network.  In  such  a  case, 

» 

fore  its  optimal  solution,  is  known,  namely  the  spanning  tree  formed  by  the 
N-l  arcs  corresponding  to  Au(j*}. 


)  can  be  fathomed  because  its  only  feasible  solution,  and  there- 


Au{jM 


The  subproblea  (p  ,  . .)  cannot  be  dealt  with  as  easily  and 


auat  be  treated  aa  follows:. 


(1)  A  lower  bound  on  v*  .  is  obtained  by  solving  (as  dis- 

cussed  in  Step  4)  the  MST  problem  (pX*  .  ). 

A,Bu{j*> 

(2)  Using  the  resulting  w*  ^.(X1),  **  ,  and 

A,Bo{j*>  A,Bu{j*> 

•*  ,  *.(X  )»  80  «tteapt  is  aade  to  fathoa  (p  *  )  by  applying  the 

fathoalng  subroutine  as  described  in  Step  5;  note  w*  .  (X1)  is  always 

A,Bu{ j*  } 

greater  than  or  equal  to  w*  ( X1)  and  aay  even  equal  •  if  Bu{  j* } 

AB 

contains  aany  arc  Indices. 

(3)  If  (P  ,  . ,)  cannot  be  fathoaed,  it  is  added  to  the  list  of 

A,BU<J*} 

unfathoaed  subprobleaa  In  the  fora  of  the  "vector  of  Information" 


[A,Bo{j* ),  X*,w*  .  *1(XI),a*  .  ^(X1)]. 

A,Bu{j*}  A,Bu{ J* } 


To  illustrate  the  branch-and-bound  algorithm  discussed  in  the 
previous  section,  consider  the  following  ezaaple  having  6  nodes,  15 
potential  arcs,  a  supply  of  bj  ■  23  units  of  resource  1,  and  a  supply  of 
b2  “  12  units  of  resource  2.  Figure  3  provides  the  data  for  each 
potential  undirected  arc  (p,q),  1  <  p  <  q  _<  6;  the  upper  left  corner  of 
the  cell  corresponding  to  arc  (p,q)  contains  the  arc's  index  j;  the 
center  of  the  cell  contains  the  cost  Cj  of  Including  the  arc  in  the 
spanning  tree;  the  lower  right  corner  contains  the  amounts  aij  and 
a£j  of  resources  1  and  2,  respectively,  consumed  by  including  the  arc 
in  the  spanning  tree.  For  exaaple,  the  arc  incident  to  nodes  3  and  5  has 
index  11  and,  if  included  in  the  spanning  tree,  would  cost  8.5  and  consume 
4  units  of  the  first  resource  and  2  units  of  the  second  resource. 
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The  application  of  the  branch-and- bound  algorithm  (with  p  -  0.6  in 

Step  3  and  an  error  tolerance  of  e  -  0  in  Step  5)  results  in  the 

beb-tree  of  Figure  4.  Each  box  (node)  of  the  bcb-tree  corresponds  to  a 

subproblem  (Pab)  and  contains ,  either  explicitly  or  implicitly,  the 

*  * 

subproblens  “vector  of  information"  [A,B,X,wAB(X),sAB(X)]  as  described  in 
the  discussion  of  Steps  1,  2,  and  10  (to  conserve  space,  w*  (X)  and 
s^fi(X)  are  abbreviated  by  w  and  s,  respectively);  if  a  box  does  not 
explicitly  contain  all  components  of  the  "vector  of  information",  it  is 
implicit  that  the  missing  items  are  identical  to  the  corresponding  items  in 
the  box' 8  "father"  in  the  bAb-tree.  The  boxes  are  numbered  according  to 
the  order  in  which  they  appeared  during  the  execution  of  the  algorithm;  two 
boxes  created  simultaneously  by  partitioning  (branching)  in  Step  7  have  the 
same  number  and  will  be  distinguished  hereafter  by  appending  "a"  to  the 
number  of  the  left  most  box  and  "b"  to  the  rightmost  box.  Thus,  at  "time" 
t  (1  <  t  <  18),  the  bAb-tree  consists  of  the  subtree  in  Figure  4  that 
spans  the  boxes  having  numbers  less  than  or  equal  to  t;  the  leaves  of  this 
subtree  comprise  the  stack  of  unfathomed  subproblems  at  "time"  t. 

Box  1,  the  root  of  the  bAb-tree,  indicates  that  the  minimal  spanning 
problem  that  results  from  ignoring  the  resource  constraints  in  (P)  has  an 
optimal  solution  that  consumes  1  more  unit  of  each  resource  than  is 
available;  hence,  the  branch-and-bound  algorithm  must  be  used.  A  box 
having  only  one  branch  leaving  it  (boxes  1,  3a,  3b,  5a,  5b, 7a,  9a,  9b,  12a, 
and  17a)  corresponds  to  the  start  of  a  sequence  of  iterations  of 
subgradient  optimization  (Steps  3-6);  the  results  of  subgradient 
optimization  appear  immediately  below  in  the  box's  only  "son",  where  the 
son  contains  "no  change"  if  subgradient  optimization  failed  to  improve  the 
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lower  bound  w*  (A);  the  intermediate  results  of  subgradient  optimization 

do  not  appear  in  Figure  4  but  instead  are  summarized  along  the  branch  from 

father  to  son  by  a  fraction  (in  parentheses)  consisting  of  a  denominator 

equal  to  the  number  of  iterations  and  a  numerator  equal  to  the  number  of 

iterations  that  resulted  in  an  improved  lower  bound.  A  box  containing  the 

results  of  a  sequence  of  iterations  of  aubgradlent  optimization  is  one  of 

two  types.  The  first  type  (boxes  2,  4,  6,  8,  11,  14,  and  16)  arises  when 

subgradient  optimization  is  terminated  via  Step  6  so  that  the  subproblem 

(PA_)  must  be  partitioned  in  Step  7  into  (p  ,  )  and  (p  ,  . 

AB7  f  pi  V  A,Bu{j*K 

represented  respectively  in  Figure  4  by  the  box's  "left"  son  and  "right" 
son;  the  second  type  (boxes  10,  13,  and  18)  arises  when  subgradient 
optimization  terminates  via  Step  5  with  the  subproblem's  fathoming  (for  the 
reason  given  in  parentheses  within  the  box).  Boxes  7b,  12b,  15a,  15b,  and 
17b,  the  only  boxes  not  yet  discussed,  each  represent  a  subproblem  created 
by  a  partitioning  in  Step  7  but  never  partitioned  further,  either  because 
it  (box  12b  or  17b)  was  fathomed  (for  the  reason  given  in  parentheses 
within  the  box)  in  Step  8  or  because  just  prior  to  the  algorithm's 
termination  it  (box  7b,  15a,  or  15b)  was  one  of  several  fathomed 
simultaneously  in  Step  10  when  the  lower  bound  of  the  top  item  (box  15a)  on 
the  stack  of  unfathomed  subproblems  exceeded  the  incumbent's  objective 
value • 

As  indicated  by  asterisks  in  Figure  4,  there  were  three  Incumbent 
changes  at  Step  C  of  the  fathoming  subroutine:  the  first  between  boxes  1 
and  2  during  a  subgradient  optimization  iteration  that  failed  to  Improve 
the  lower  bound  W^B^^  acK*  the  second  and  third  in  boxes  13  and  17b, 
respectively,  when  the  subproblems  they  represent  were  fathomed  due  to 
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complementary  slackness.  Note  that  the  third  and  last  incumbent  is 
optimal.  The  optimal  spanning  tree  consists  of  arcs  (1*6),  (6,5),  (1,2), 
(6,4),  and  (4,3);  it  has  a  total  cost  of  22.7  and  consumes  23  units  of  the 
first  resource  and  12  units  of  the  second  resource. 

This  small  example  illustrates  the  potential  advantages  of  a 
branch-aud-bound  approach  based  on  Lagrangean  relaxation.  Although  only  8 
of  the  49  iterations  of  subgradient  optimization  resulted  in  an  improvement 
of  at  least  0.1%  in  the  lover  bound,  these  8  increases  in  the  lover  bound 
together  vith  the  three  incumbent  changes  resulted  in  a  small  b&b-tree. 

As  discussed  at  the  end  of  Section  6,  a  more  traditional  branch-and-bound 
approach  that  bounds  the  optimal  objective  value  of  (P  )  only  once  by 
solving  (P^)  results  in  a  b&b-tree  having  over  400  nodes . 


4.  SOLVING  THE  RCHST  PROBLEM 

If  e^  <  *or  sowe  arc  J*  then  the  optimal  solution  to  (P) 

need  not  satisfy  every  arc  capacity  constraint.  Consequently,  the 
branch-and-bound  algorithm  of  the  previous  section  must  be  modified. 

Recall  that  T  denotes  the  finite  set  of  incidence  vectors 

corresponding  to  trees.  Let  F  denote  a  subset  of  7  such  that  x  e  F  } 

i 

if  and  only  if  x  corresponds  to  a  tree  in  vhlch  there  exists  a  feasible  ! 

i 

flow,  that  is,  a  flov  from  the  source  satisfying  the  demands  at  the  sinks  j 

without  violating  any  arc  capacity  constraints.  The  RCMST  problem  can  now  t 

f 

be  expressed  as  i 

i 

! 

i 

i 
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(Q)  Minimize 

subject  to  l ^  jxj  £  for  1  <  i  _<  m 

and  x  e  F 

Given  a  set  A  consisting  of  indices  of  '‘admitted*’  arcs  and  a  set 

B  consisting  of  Indices  of  "banished**  arcs,  define  the  subproblem  (QAn) 

AB 

by 

(Q^)  Minimize 

subject  to  aijX  j  —  '’I  *or  *  —  1  —  m  * 

and  x  c  , 

where  ?A|t  •  P  n  {x|xj  ■  1  for  j  c  a)  n  {x|x^  »  0  for  j  £  b).  Since 

F._  c  T  ,  the  optimal  objective  value  of  (p\, )  for  any  nonnegative  X 

furnishes  a  lower  bound  on  the  optimal  objective  value  of  (Q  );  that  is, 

AB 

the  optimal  objective  value  *>f  (Q._)  can  be  bounded  from  below  by 

relaxing  the  resource  constraints  and  ignoring  the  requirement  that  there 
exist  a  feasible  flow  in  the  tree  corresponding  to  x.  Ignoring  rather 
than  relaxing  the  requirement  of  a  feasible  flow  is  necessary  because 
x  c  cannot  be  expressed  as  a  system  of  linear  inequalities  in  the 

binary  vector  x. 

Overview  of  Necessary  Modifications.  Suppose  that  the  subproblem 
(Q^g)  is  under  consideration  at  some  point  in  the  branch-and-bound 
algorithm.  Recall  that  if  A  *  the  A-Arcs  (the  arcs  whose  indices  are 
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in  A)  form  the  A-subtree  which  includes  the  source  as  one  of  its  nodes* 
Given  the  A-subtree  and  j  e  A,  let  f j  denote  the  unique  flow  on  arc 
j  necessary  if  the  source  is  to  satisfy  the  demands  of  the  other  nodes  in 
the  A-subtree*  For  example,  consider  the  A-subtree  of  Figure  5,  where 
node  1  is  the  source,  the  demand  dp  for  each  other  node  p  is  shown 
adjacent  to  the  node,  and  the  ordered  pair  adjacent  to  each  arc  j  con¬ 
sists  respectively  of  the  capacity  ej  of  the  arc  and  the  unique  flow 
fj  on  the  arc  necessary  if  the  source  is  to  satisfy  all  demands*  Assume 
Inductively  that  {fj| j  e  A)  is  known  and  is  a  component  of  the  "vector 

of  information"  for  the  subproblem  (Q  ).  Also  assume  inductively  that 

An 

instead  of  being  stored  in  the  "vector  of  information"  as  a  set  of  arc 
Indices,  A  is  stored  as  an  ordered  list  of  ordered  pairs  of  nodes,  where 
an  ordered  pair  (p,q)  appears  in  the  k-th  position  on  the  list  if  the 
undirected  arc  incident  to  nodes  p  and  q  was  the  k-th  arc  added  to 
the  A-subtree  and  the  direction  of  flow  on  the  arc  is  from  p  to  q;  note 
that  the  index  of  arc  (p,q)  can  be  computed  easily  whenever  needed  from 
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the  formula  given  at  the  beginning  of  Section  1.  For  the  example  of  Figure 
5,  suppose  A  is  stored  as  the  following  ordered  list  of  ordered  pairs 


Arc  (p,q) 

Index  j 

(1,11) 

10 

(11,4) 

46 

(1,6) 

5 

(11,12) 

96 

(12,15) 

102 

(11,7) 

73 

(12,2) 

24 

where  the  indicated  index  of  each  ordered  pair  (p,q)  is  not  part  of  the 
data  structure  but  is  computed  whenever  needed  from  the  formula  given  at 
the  beginning  of  Section  1  (with  N  *  IS);  note  that  the  direction  of  flow 

on  each  arc  is  from  p  to  q*  Given  such  a  data  structure  for  A,  it  is 

simple  to  update  the  flows  when  an  arc  is  added  to  the  A-subtree;  the 
procedure  would  be  as  follows: 

(1)  Let  (p,q)  denote  the  arc  to  be  added ,  where  p  is  a  node  in 
the  A-subtree  and  q  is  not;  of  course,  the  flow  on  arc  (p,q)  must  be 

V 

(2)  increase  by  dq  the  flow  on  each  arc  of  the  unique  path  froa 

the  source  to  node  p;  note  that  this  is  easily  done  in  one  upward  paas 

through  the  data  structure  for  A  since  the  ordered  pair  (r,s)  that  aust 
precede  the  ordered  pair  (s,t)  on  the  only  path  froa  the  source  to  node 
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p  is  the  unique  ordered  pair  higher  on  the  list  in  which  s  appears  as 
the  second  component.  In  the  example  of  Figure  5,  suppose  that  an  arc 
(2,q)  is  added  to  the  A-subtree;  then  by  repeatedly  scanning  the  second 
component  of  the  above  data  structure  for  A,  the  flows  on  the  arcs  of  the 
unique  path  from  the  source  to  node  2  are  increased  by  dq  in  the 
reverse  order  (12,2),  (11,12),  and  (1,11). 

Given  the  above  overview,  it  is  now  possible  to  describe  the 
modifications  to  the  branch-and-bound  algorithm  of  Section  2  necessary  for 
it  to  solve  (Q)  Instead  of  (P),  that  is,  the  RCMST  problem  Instead  of 
the  RMST  problem. 

Steps  1,  2,  and  10.  As  discussed  in  the  overview,  the  "vector  of 
information"  characterizing  a  subproblem  (Qah)  now  includes  the  current 
values  of  the  flows  on  the  arcs  of  the  A-subtree.  In  particular,  the 
"vector  of  Information"  is  [A,B,{fjJj  e  A},A,w^(A),8^B(A)] ,  where  A  is 
stored  as  the  data  structure  discussed  in  the  overview.  Since  Cf ^  j  j  f  a) 
is  uniquely  determined  by  A,  an  alternative  to  including  ^ | J  e  A)  in 
the  "vector  of  information"  is  computing  it  whenever  necessary;  however, 
because  the  computation  cannot  be  performed  in  a  straightforward  manner, 
the  tradeoff  between  increased  computation  time  and  decreased  storage  does 
not  seem  to  favor  this  alternative. 

Step  3.  No  modifications  are  necessary. 

Step  4.  The  feasibility  check  in  Part  B  of  the  Fathoming  Sub¬ 
routine  will  be  facilitated  if,  as  the  Prlm-Dljkstra  algorithm  starts  with 
the  A-subtree  and  adds  an  arc  at  each  Iteration,  the  flows  on  the  arcs  of 
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each  successive  subtree  are  updated  (using  the  procedure  discussed  in  the 
overview)  until  either  (1)  an  arc  is  added  at  some  Iteration  that  forces 
the  flow  on  at  least  one  arc  of  the  current  subtree  to  exceed  its  capacity 
or  (2)  the  optimal  solution  to  (P^  )  is  obtained  and  the  flow  on  the 
corresponding  tree  satisfies  the  arc  capacity  constraints*  Note  that  (1) 
may  occur  since  the  requirement  that  there  exist  a  feasible  flow  in  the 
optimal  solution  is  not  present  in  (P^)  • 

Step  5*  The  Fathoming  Subroutine  makes  and  attempt  to  fathom  the 
subproblem  (Q^)  using  the  results  of  solving  (P^)  for  some  X  >_  0* 

Of  course,  the  feasibility  check  in  Part  B  now  refers  to  checking  whether 
x^b(X)  is  a  feasible  solution  of  (Q^)  and,  therefore,  (Q);  the  check  is 
easy  given  and  the  modification  described  in  Step  4. 


Step  6*  No  modifications  are  necessary. 


Steps  7,  8,  and  9*  No  modifications  are  necessary  to  Step  7;  as 

before,  j*  is  computed  and  CQ^g)  partitioned  into  the  two  subproblems 

(Q  .  )  and  (q  .  ).  The  latter  subproblem  is  treated  as  before 

in  Step*  8  and  9;  however,  the  former  subproblem  is  handled  differently. 

First,  an  attempt  is  made  to  fathom  (Q  .  )  by  checking  for  the 

Au{j  },B 

occurrence  of  one  of  the  two  situations  described  in  the  discussion  of  Step 
8  in  Section  3;  then,  if  this  is  unsuccessful,  the  flows  on  the  arcs  of  the 
Au{j*}-8ubtree  are  updated  (using  the  procedure  discussed  in  the  overview) 
to  reflect  the  addition  of  the  arc  j*  to  the  A-subtree.  If  the  updated 
flow  violates  at  least  one  of  the  arc  capacity  constraints, 
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ia  fathomed  because  it  has  no  feasible  solution;  otherwise ,  (q  . %  )  is 

added  to  the  stack  of  unfathomed  subproblems  in  the  form  of  the  Mvector  of 

Information  [a  u  {j*),B,{f.|j  €  A  u  {j .  (A1),**  *  (A1)]. 

AU{ j*}  ,B  Au{j*},B 


5.  SOLVING  EXTENSIONS  OF  THE  RCMST  PROBLEM 
This  section  discusses  the  modifications  to  the  branch-and-bound 
algorithm  necessary  to  analyze  two  extensions  of  the  resource-constrained , 
capacitated  minimal  spanning  tree  problem:  the  existence  of  multiple  arcs 
between  each  pair  of  nodes  and  the  existence  of  multiple  sources. 


Multiple  Arcs  Between  Each  Pair  of  Nodes 

In  many  practical  situations,  it  is  possible  to  construct  an  arc 
between  a  pair  of  nodes  in  a  variety  of  ways,  with  each  way  having  its  own 
associated  cost,  capacity,  and  consumption  of  resources.  For  example,  it 
may  be  possible  to  increase  the  capacity  of  an  arc  between  a  pair  of  nodes 
by  simultaneously  increasing  the  construction  cost.  Increasing  the 
consumption  of  some  subset  of  resources,  and  decreasing  the  consumption  of 
another  subset  of  resources. 

Although  requiring  additional  notation  to  explain,  the  modifications 
to  the  branch-and-bound  algorithm  necessitated  by  the  existence  of  multiple 
arcs  between  each  pair  of  nodes  do  not  require  a  significant  Increase  in 
computational  effort.  More  specifically,  assume  the  indices  1,  2,  ...,  n 
of  the  potential  arcs  for  the  spanning  tree  resulted  from  an  arbitrary 
indexing  rather  than  from  the  method  described  at  the  beginning  of  Section 
1;  for  each  node  pair  (p»q)  with  p  <  q,  let  denote  a  set  of  arc 

indices  such  that  J  c  J  if  and  only  if  arc  j  is  Incident  to  nodes  p 

pq 
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and  q.  The  only  modification  to  the  branch-and-bound  algorithm  occurs  in 
Step  4,  the  solution  of  (Pj^)  f°r  a  given  A,  B,  and  in  particular , 
(P^g)  is  now  solved  as  follows: 

(1)  Form  the  A-subtree* 

(2)  For  each  node  pair  (p,q)  for  which  at  least  one  node  is  not 

in  the  A-subtree ,  temporarily  replace  the  multiple  arcs 

incident  to  the  two  nodes  by  a  single  arc  having  an  associated 

weight  of  min  _g[c  +  X  a ±  )  if  J  -  B  *  +  or  - 

pq 

if  J  c  B. 

pq  - 

(3)  Starting  with  the  A-subtree,  use  the  Prim-Di jkstra  algorithm 
as  described  by  Prim  [21]  to  solve  the  minimal  spanning  tree 
problem  with  the  arc  weights  as  computed  in  (2). 

Note  that  the  only  “extra  work”  necessitated  by  multiple  arcs  between  each 

pair  of  nodes  is  the  computations  described  in  (2);  since  the  effect  of  (2) 

is  to  Ignore  all  but  the  “cheapest”  arc  (as  measured  by  the  revised  cost 

cj  +  L±mi  \aij^  between  a  pair  of  nodes,  there  is  no  increase  in  the 

size  of  the  minimal  spanning  tree  problem  that  must  be  solved  to  determine 

the  optimal  spanning  tree  for  (P^  ). 

Ad 


Multiple  Sources 

Consider  an  extension  of  the  problem  in  which  each  node  must  have 
access  to  one  and  only  one  supply  center  (hereafter,  a  source)  from  which 
it  will  receive  a  particular  commodity*  Suppose  there  are  two  means  of 
creating  access  from  a  node  to  a  source:  (1)  direct  access,  that  is, 
construction  of  a  source  at  the  node  itself,  and  (2)  indirect  access,  that 


Is,  construction  of  a  unique  path  to  the  node  from  one  and  only  one  other 
node  at  which  a  source  has  been  built*  Clearly,  the  resulting  network  is  a 
spanning  forest,  that  is,  a  network  in  which  each  node  belongs  to  one  and 
only  one  of  a  set  of  disconnected  trees;  note  that  each  tree  in  the 
spanning  forest  contains  a  single  source  and  the  (possibly  empty)  set  of 
nodes  it  supplies  in  addition  to  itself.  Restricting  the  network  to  a 
spanning  forest  implies  that  there  are  reasons  (perhaps  physical  or 
technological)  that  prevent  the  flow  destined  for  a  particular  node  to  be 
transmitted  simultaneously  from  more  than  one  source  or  along  more  than  one 
path. 


As  before,  if  the  spanning  forest  ultimately  includes  a  potential 
undirected  arc,  the  arc  would  have  a  known  flow  capacity  and  would  result 
in  the  incurring  of  a  known  cost  and  the  consumption  of  known  quantities  of 
each  of  the  resources.  Also  as  before,  associated  with  each  node  is  a 
known  demand  for  the  commodity;  however,  in  addition,  if  a  source  were 
constructed  at  node  p,  it  would  have  a  known  supply  of  e^  units  and 
would  result  in  the  incurring  of  a  known  cost  c^  and  the  consumption  of 
a^  units  of  resource  1,  1  <  i  <  m.  Given  the  above  quantities  as  well 
as  the  available  supply  of  each  resource  used  in  the  construction  of  arcs 
and/or  sources,  the  problem  is  to  construct  a  minimal  cost  spanning  forest 
subject  to  the  following  requirements:  (1)  all  resource  constraints  are 
satisfied,  (2)  each  tree  in  the  forest  contains  exactly  one  node  at  which  a 
source  has  been  constructed,  and  (3)  there  exists  a  feasible  flow  in  each 
tree  in  the  forest.  Note  that  a  resource  constraint  cannot  only  be  used 
(as  indicated  in  Section  1)  to  limit  the  degree  of  a  node  in  the  spanning 
forest  but  can  also  be  used  to  limit  the  number  of  sources  constructed. 
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A  straightforward  procedure  transforms  this  minimal  spanning  forest 


problem  into  an  RCMST  problem;  more  specifically,  augment  the  original 

N-node  network  with  a  super-source,  a  new  node  having  an  Infinite  supply  of 

the  commodity,  and  join  each  node  p  to  the  super-source  with  an 

artificial  arc  having  a  capacity  of  e',  a  cost  of  c',  and  resource 

P  P 

consumptions  a^,  1  <  i  <  m.  Thus,  the  data  associated  with  the  construc¬ 
tion  of  a  facility  at  node  p  is  now  associated  with  the  artificial  arc 
joining  node  p  with  the  super-source.  Note  that  multiple  artificial  arcs 
between  a  node  and  the  super-source  could  be  used  (as  discussed  earlier  in 
this  section)  if  there  were  more  than  one  way  to  construct  a  source  at  node 
p.  Clearly,  the  optimal  spanning  tree  in  the  revised  network  is  equivalent 
to  the  optimal  spanning  forest  in  the  original  network;  in  particular,  the 
optimal  spanning  forest  for  the  original  problem  is  obtained  from  the 
optimal  spanning  tree  for  the  revised  problem  by  deleting  the  super-source 
and  any  arc  incident  to  it,  with  the  understanding  that  a  source  is  con¬ 
structed  at  each  node  to  which  a  deleted  artificial  arc  was  incident. 

Thus,  this  multiple-source  version  of  the  problem  is  equivalent  to  an  RCMST 
problem  with  one  more  node  than  the  original  problem;  as  such,  its  solution 
entails  a  negligible  increase  in  computational  effort  over  the  RCMST 
problem. 

6.  COMPUTATIONAL  EXPERIENCE  AND  CONCLUSIONS 
A  FORTRAN  computer  program  for  solving  the  RCMST  problem  has  been 
Implemented  on  the  IBM  3033  computer  at  Stanford  University.  The  computer 
program  consists  of  approximately  1000  statements.  The  variable  memory 
requirements  of  the  program  are  a  function  of  the  number  of  nodes  in  the 
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network,  the  number  of  resource  constraints,  and  the  maximum  number  of 
unfathomed  subproblems  that  may  be  on  the  stack  simultaneously;  denote 
these  parameters  by  N,  m,  and  S,  respectively.  The  required  total  number 
of  kilobytes  (1000  bytes)  of  memory  is  given  by 

+ 

Table  1  tabulates  the  above  expression  as  a  function  of  S  for  various 
values  of  N  and  m;  the  table  is  approximate  in  the  sense  that  the 
constant  term  has  been  rounded  to  one  decimal  place  and  the  coefficient  of 
S  has  been  rounded  to  three  decimal  places.  It  can  be  seen  from  both  the 
expression  and  the  table  that  the  memory  requirement  is  most  affected  by 
S;  the  last  column  of  Table  I  provides  the  maximum  value  of  S  assuming  an 
availability  of  at  most  7000  kilobytes  of  memory,  the  approximate 
availability  of  memory  on  Stanford's  IBM  3033.  Table  I,  in  conjunction 
with  the  computational  experience  described  below,  indicates  that  in  most 
cases  the  limiting  factor  in  solving  RCMST  problems  should  be  the  execution 
time  rather  than  the  memory  requirement. 

In  order  to  gain  some  preliminary  computational  experience  with  the 
algorithm,  a  random-problem  generator  was  constructed;  it  executes  the 
following  steps; 

(1)  The  determination  of  the  demands  at  the  nodes  is  via  one  of 
three  methods,  depending  on  which  problem  type  is  desired.  To  obtain  the 
most  general  RCMST  problem,  the  demand  dp  at  node  P  (2  <  p  <  N)  is  an 
independent  random  variable  uniformly  distributed  on  the  integers  in  the 
Interval  [1,  50].  To  obtain  an  important  special  case  of  the  RCMST 
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problem,  dp  is  set  equal  to  1  for  2  <  p  <  N.  Finally,  to  obtain  an 
RMST  problem  (i.e.,  without  flow  constraints),  dp  is  set  equal  to  0 
for  2  <  p  <  N. 

(2)  To  insure  the  existence  of  at  least  one  feasible  solution  to 
the  RCMST  problem,  a  feasible  tree  is  randomly  generated  In  N~1 
iterations.  More  specifically,  the  trivial  subtree  consisting  only  of  node 
1  is  iteratively  expanded;  iteration  k  consists  of  adding  arc  (p,q)  to 
the  subtree,  where  p  is  randomly  selected  from  the  k  nodes  belonging  to 
the  current  subtree  and  q  is  randomly  selected  from  the  N-k  nodes  not 


yet  a  member  of  the  current  subtree.  Let  denote  the  set  of  indices  of 

those  arcs  comprising  the  randomly  generated  trees  and,  for  j  e  T ,  let 
f j  denote  the  flow  on  arc  j  that  would  be  necessary  to  satisfy  the  node 
demands.  Then,  for  j  e  T^,  the  flow  capacity  is  an  independent 

random  variable  uniformly  distributed  on  the  integers  in  the  interval 
[f y  note  that  this  insures  that  the  randomly  generated  tree  will 

always  satisfy  the  flow  capacity  constraints.  Also,  for  j  e  T  ,  the 
construction  cost  c^  is  an  Independent  random  variable  uniformly 
distributed  on  the  Integers  in  the  Interval  [0,  99],  and  the  consumption 
a^j  of  resource  i  (1  _<  i  _<  m)  is  an  Independent  random  variable 
uniformly  distributed  on  the  integers  in  the  interval  [0,9]. 

(3)  Recall  that  there  are  potentially  n  -  (1/2)(N)(N-1 ) 


undirected  arcs,  each  with  a  distinct  index  j  equal  to  its  position  in  a 
lexicographic  ordering  of  the  n  arcs  based  on  the  representation  of  an 
arc  as  a  vector  (p,q)  with  p  <  q.  For  each  arc  j  that  is  not  a  member 
of  the  randomly  generated  tree,  an  Independent  random  number  is 

generated  that  is  uniformly  distributed  over  the  continuous  interval 
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[0,1].  If  Pj  <  (10/N) ,  then  arc  J  is  referred  to  as  a  "potential  arc"; 

the  associated  c^  and  a^  (1  <  i  <  m)  are  randomly  generated  as 

described  in  Step  2,  but  the  flow  capacity  e^  is  an  independent  random 

variable  uniformly  distributed  on  the  Integers  in  the  interval 

[minimum  d  ,  J®  ^  d  ].  If  P.  >  (10/N),  then  arc  j  is  effectively 
2<p<n  P  h*2  P  J 

eliminated  from  inclusion  in  the  optimal  spanning  tree  because  c^  and 

(1  i  £  m)  are  set  equal  to  an  extremely  large  number  and  e ^  is  set 

equal  to  zero.  The  usage  of  (10/N)  as  the  "cutoff  valve"  for  p^ 

implies  that,  for  n  10,  the  expected  number  of  potential  arcs  for 

inclusion  in  the  spanning  tree  is  5(N-1)  +  A,  where  0  <  A  <  (N-l) 

reflects  the  special  treatment  given  to  the  arcs  of  the  randomly  generated 

tree;  thus  between  5N  and  6N  is  a  reasonable  estimate  for  the  number  of 

potential  arcs  in  any  randomly  generated  problem. 

(4)  The  remaining  step  is  to  determine  values  for  b,  an  m-vector 

whose  i-th  component  is  the  availability  b^  of  resource  i 

(1  <  i  <  m).  Let  b  denote  an  m-vector  whose  i-th  component  is  the 
—  Li 

amount  of  resource  1  consumed  by  the  randomly  generated  spanning  tree  of 
Step  2.  Also,  let  b^  denote  an  m-vector  whose  i-th  component  is  the 
maximum  amount  of  resource  i  consumed  by  any  spanning  tree  comprised  of 
any  of  the  potential  arcs;  this  maximal  usage  of  resource  1  is  found  by 
solving  a  maximal  spanning  tree  problem  where  the  "cost"  of  arc  j  is 
a^j.  Finally,  for  some  constant  X  satisfying  0  <  X  £  1,  let 
b  ■  (l-X)bT  +  Xbn.  Note  with  this  choice  of  b  that  the  randomly 
generated  spanning  tree  of  Step  (2)  satisfies  the  resource  constraints  for 
all  values  of  X;  also  note  that  as  X  increases  from  0  to  1,  the 
number  of  spanning  trees  satisfying  the  resource  constraints  also 
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Increases.  Rather  than  use  b  ■  (l-X)b  +  Xb  for  some  0  <  X  <  1,  a 

L  U 

slight  modification  is  made.  More  specifically,  to  Insure  a  nontrivial 
solution  to  the  RCMST  problem,  it  is  necessary  to  insure  the  infeasibility 
of  the  spanning  tree  that  solves  the  simple  MST  problem  with  the  arc  costs 
of  the  RCMST  problem.  To  do  so,  this  simple  MST  problem  is  solved,  some 
resource  i*  is  chosen  for  which  the  consumption  of  resource  i*  in  the 
MST  equals  a  value  v  that  is  strictly  greater  than  component  i*  of  by, 
and  component  i*  of  by  is  reset  to  v.  (Note  that  the  assumption  of 
the  existence  of  such  an  i*  is  made  without  loss  of  generality  since  such 
a  condition  can  be  obtained  eventually  by  simply  discarding  the  current  set 
of  data  and  returning  to  Steps  (2)  and  (3)  to  generate  new  data.)  After 
resetting  component  I*  of  by,  recomputing  b  *  (l-X)by  +  Aby  (0  X  <  1) 
leads  to  a  set  of  resource  constraints  that  is  always  satisfied  by  the 
randomly  generated  spanning  tree  of  Step  (2)  but  never  satisfied  by  the 
solution  to  the  simple  MST  problem;  thus,  a  nontrivial  optimal  solution  to 
the  RCMST  problem  exists.  In  the  computational  experience  discussed  below, 
X-  0.5  was  used. 

Tables  II,  III,  and  IV  summarize  the  results  of  some  of  the 
computational  experience.  Table  II  summarizes  results  for  six  RMST 
problems  each  having  50  nodes  and  5  resource  constraints;  Table  III 
summarizes  the  results  for  six  RCMST  problems  each  having  20  nodes,  3 
resource  constraints,  and  a  unit  demand  at  every  node;  and  Table  IV 
summarizes  the  results  for  six  RCMST  problems  having  20  nodes,  3  resource 
constraints,  and  random  node  demands  as  described  in  Step  (1)  of  the 
random-problem  generator.  The  column  headings  of  Table  II  are  described 
more  explicitly  by  the  following: 
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(1)  The  second  column  contains  lOOe.  Recall  that  100c  is  the 
maximum  percentage  error  that  might  result  from  using  the  fathoming  rules 
discussed  in  Section  3;  that  la,  the  cost  of  the  "e-optimal**  solution  to 
the  problem  may  be  at  most  100c  percent  higher  than  the  exact  ( e^O) 
minimal  cost*  The  actual  percentage  error  that  resulted  is  given  in  the 
ninth  and  last  column  of  Table  II* 

(2)  The  third  column  contains  the  number  of  nodes  In  the 
branch-and-bound  tree  generated  to  solve  the  problem. 

(3)  The  fourth  column  contains  the  number  of  MST  problems  solved 
during  the  executions  of  Steps  4  and  8  of  the  algorithm. 

(4)  The  fifth  column  contains  the  maximum  number  of  unfathomed 
subproblems  that  were  simultaneously  on  the  stack  and,  in  conjunction  with 
Table  I,  provides  insight  into  the  memory  requirements  of  the  problem* 

(5)  The  sixth,  seventh  and  eighth  columns  are  related*  The  sixth 
column  (labeled  (a))  contains  the  CPU  time  (excluding  compilation)  that 
elapsed  until  the  eventual  e-optimal  solution  became  the  Incumbent 
solution,  and  the  seventh  column  (labeled  (b))  contains  the  total  CPU  time 
(excluding  compilation)  required  to  solve  the  problem.  The  ratio 
100(b-a)/b  contained  in  the  eighth  column  is  the  percentage  of  the  total 
execution  time  that  was  required  to  verify  that  the  e-optimal  solution 
that  became  the  Incumbent  at  the  time  given  In  the  column  labeled  (a)  was. 
In  fact,  an  e-optimal  solution;  In  this  sense,  the  ratio  measures  "wasted" 
computational  effort.  The  above  descriptions  also  apply  to  the  headings  of 
the  columns  of  Tables  III  and  IV* 
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The  purpose  of  the  computational  experience  summarized  by  Tables  II 


III,  and  IV  was  to  demonstrate  the  algorithm's  potential  to  solve  large 
problems  and  to  gain  insight  into  the  algorithm's  behavior  while  solving  a 
series  of  related  problems.  The  reported  execution  times  are  meaningful 
only  in  this  context.  Lower  (Higher)  average  execution  times  for  similar 
problems  could  have  been  obtained  by  decreasing  (increasing)  the  arc 
density  in  Step  (3)  of  the  random-problem  generator  and/or  by  increasing 
(decreasing)  X  in  Step  (4)  of  the  random-problem  generator.  Also, 
significantly  lower  execution  times  would  result  if  a  computer  programmer 
more  knowledgeable  than  this  author  were  to  Implement  a  more  sophisticated 
algorithm  (c.f.,  [4],  [19],  or  [24])  for  solving  the  MST  problems  in  Steps 
(4)  and  (8)  of  the  algorithm;  the  solution  of  the  MST  problems  constitutes 
a  major  portion  of  the  computational  effort  so  that  a  more  efficient 
algorithm  would  have  a  significant  favorable  impact  on  execution  times. 
Another  operation  done  repetlvely  during  the  algorithm's  execution  is  the 
insertion  of  a  subproblem  into  its  proper  position  on  the  stack  of 
unfathomed  subproblems  based  on  the  value  of  its  lower  bound;  currently 
done  in  a  somewhat  naive  manner,  this  operation  could  be  coded  by  a  more 
sophisticated  computer  programmer  than  this  author  to  execute  significantly 
faster.  A  final  potential  way  to  reduce  execution  time  is  to  "fine-tune" 
the  parameters  used  to  revise  X  in  Step  (3)  of  the  algorithm  as  described 
in  Section  3. 

In  light  of  the  comments  of  the  preceding  paragraph,  conjectures 
rather  than  conclusions  are  in  order.  Table  II  indicates  that  the 
algorithm  has  the  potential  to  solve  very  large  RMST  problems,  especially 
if  one  is  willing  to  forego  exact  optimality  and  accept  accuracy  to  within 
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1Z  or  even  5Z.  However,  Tables  111  and  IV  indicate  that  the  algorithms 
potential  for  solving  large  RCMST  problems  is  less  promising,  even  if  one 
is  willing  to  accept  accuracy  to  within  5Z  rather  than  exact  optimality. 
However,  since  the  i-th  problem  of  Table  III  is  identical  to  the  i-th 
problem  of  Table  IV  with  the  exception  of  node  demands,  it  does  appear  that 
the  RCMST  problem  with  unit  demands  is  significantly  easier  to  solve  than 
the  general  RCMST  problem. 

One  final  point  should  be  made.  It  is  possible  to  M trick**  the 
computer  program  into  the  more  traditional  branch-and-bound  approach  that 
bounds  a  subproblem  (P  )  by  solving  only  the  relaxation  (P^  ),  that  is, 
the  MST  problem  that  results  from  ignoring  the  resource  constraints.  Thus, 
the  traditional  approach  and  the  Lagrangean-based  approach  can  be  compared 
with  the  same  program  on  the  computer.  Computational  experience  indicates 
that  a  traditional  branch-and-bound  approach  to  the  RMST  and  RCMST  problems 
falls  due  to  a  lack  of  sufficient  computer  memory;  because  of  the  frequent 
branching  of  the  traditional  approach,  the  size  of  the  list  of  unfathomed 
subproblems  grows  so  rapidly  that  available  computer  memory  is  rapidly 
exceeded.  This  is  illustrated  by  the  example  at  the  end  of  Section  3  where 
the  branch-and-bound  algorithm  based  on  Lagrangean  relaxation  resulted  in  a 
b&b-tree  with  only  18  nodes  as  compared  to  one  with  over  400  nodes 
resulting  from  the  traditional  approach. 
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Table  I 


Memory  Requirements  for  Computer  Program 


N 

in 

Approximate  Memory 
Requirement  (Kllobytea) 

Maximum  Value  of  S 
Assuming  Availability 
of  7000  Kilobytes  of  Memory 

10 

5 

1.9  +  0.110S 

63,619 

20 

5 

7.4  +  0.188S 

37,194 

30 

5 

16.5  +  0.278S 

25,120 

40 

5 

29.3  +  0.382S 

18,247 

50 

5 

45.6  +  0.497S 

13,992 

10 

5 

1.9  +  0.110S 

63,619 

20 

10 

11.2  +  0.228S 

30,652 

30 

15 

33.9  +  0.356S 

19,458 

40 

20 

76.1  +  0.502S 

13,792 

50 

25 

143.6  +  0.657S 

10,435 

10 

10 

2.8  +  0.150S 

46,648 

20 

20 

18.8  +  0.308S 

22,666 

30 

30 

60.0  +  0.478S 

14,518 

40 

40 

138.5  +  0.662S 

10,364 

50 

50 

266.1  +  0.8578 

7,857 
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